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Abstract 

We continue development of the theory of contractive Markov systems 
initiated in [15]. In this paper, we construct the coding map for Feller 
contractive Markov systems. This allows us to prove a generalization 
of Ledrappier's Theorem [10] and to show the existence of observable 
invariant measures for Feller contractive Markov system. 
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1 Introduction 

In [15], the author introduced a concept of contractive Markov systems (CMSs). 
It unifies some structures which arise in different areas of mathematics, such as 
finite Markov chains; learning models [6]; g-measures [8], [10], [13], [7]; iterated 
{unction systems with place- dependent probabilities [1], [3]; graph- directed con- 
structions of 'fractal' sets [11]. It can be seen as a part of a general theory of 
random systems with complete connections [5]. However, the proposed struc- 
ture seems already to have a sufficient level of generality which allows one to 
see some "forest" behind the "trees" and to contribute some new results also to 
other areas of mathematics such as ergodic theory [14], [9]. 

So, what is a Markov system. It is a structure on a metric space which generates 
a discrete-time Markov process on it. 

Let K\,K2,—, Km be a partition of a metric space K into non-empty Borel sub- 
sets (we do not exclude the case N — 1). Furthermore, for each i £ {1, 2, N}, 
let 

Wn,Wi2,...,WiLi ■ K t — > K 
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be a family of Borel measurable maps such that for each j € {1, 2, Li} there 
exists n G {1, 2, TV} such that Wij (Ki) C K n (Fig. 1). Finally, for each 
i e {1,2, ...,7V}, let 

Pil,Pi2, -,PiLi ■ Ki — > R + 
be a family of positive Borel measurable probability functions (associated with 
the maps), i.e. Pij > for all j and X^=i Pij( x ) = 1 f° r a U x ^ Ki. 

N = 3 K 2 




Fig. 1. A Markov system. 



Definition 1 We call V := {1, N} the set of vertices and the subsets K\, 
are called the vertex sets. Further, we call 

E := {(i,m) : i e {l,...,7V},n, G {l,...,Lj}} 

ifte sei o/ edges and we use the following notations: 

Pe ■— Pin and w e := u>i n for e := («, n) G E. 

Each edge is provided with a direction (an arrow) by marking an initial vertex 
through the map 

i : E — > V 
(j, n) i — ► j. 

The terminal vertex t(j,n) G V of an edge (j, n) G E is determined by the 
corresponding map through 

t((j,n)) := fc : 4=^ w 3n {K 3 )dK k . 

We call the quadruple G :— (V,E,i,t) a directed (multi)graph or digraph. A 
sequence (finite or infinite) (..., e_i, eo, ei, ...) of edges which corresponds to a 
walk along the arrows of the digraph (i.e. t(ek) = i(ek+i)) is called a path. 
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Definition 2 We call the family M. :— (-fQ(e), w e,Pe) eeE a Markov system. 

Definition 3 A Markov system is called irreducible or aperiodic if and only if 
its directed graph is irreducible or aperiodic respectively. 

Definition 4 (CMS) We call a Markov system (-fQ( e ), w e,Pe) eeE contractive 
with an average contracting rate < a < 1 iff it satisfies the following condition 
of contractiveness on average: 

^ p e (x)d(w e (x), w e (y)) < ad(x, y) for all x,y £ Ki and i E {1, TV} (1) 

e£E 

(it is understood here that p e 's are extended on the whole space by zero and 
w e 's arbitrarily). This condition was discovered by Richard Isaac in 1962 for 
the case N = 1 [6]. 

Remark 1 Note that also the situation applies where each vertex set Ki has 
its own metric di. In this case, one can set 

di(x,y) if x,y e Ki 
oo otherwise 



d(x,y) -- 

and use the convention x oo = 



A Markov system (-fQ( e ), w e,Pe) eeE determines a Markov operator U on the set 
of all bounded Borel measurable functions C° (K) by 

Uf:=Y,Pefow e for & WfeC°(K) 

e€E 

and its adjoint operator U* on the set of all Borel probability measures P(K) 

by 

U*v{f) := J U{f)dv for all / e C°(K) and v E P{K). 

We say a probability measure [i is an invariant probability measure of the Markov 
system if and only if it is a stationary initial distribution of the associated 
Markov process, i.e. 

U*n = (i. 

A Borel probability measure \i is called attractive measure of the CMS if and 
only if 

tTV^/i for all v e P(K), 

where w* means weak* convergence. Note that an attractive probability mea- 
sure is a unique invariant probability measure of the CMS if U maps continuous 
functions on continuous functions. 

We shall denote the Borel cr-algebra on a set X by B{X). 
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In [16], we constructed an important tool for CMSs called the coding map. We 
showed that it is defined almost everywhere with respect to a natural measure 
on the code space if any two probability measures representing Markov processes 
with Dirac initial distributions concentrated on some points in the same vertex 
set are absolutely continuous. In [18], we showed that this condition also im- 
plies the uniqueness of the invariant probability measure. Moreover, we showed 
that this condition is satisfied if the probability functions p e \K i{c) have square 
summable variation, i.e. for any b > and < c < 1, 

oo 
n=0 

where <f> is the modulus of uniform continuity of the probability function, i.e. 

<j>{t) := sup{|p e (x) -p e (y)\ ■ d(x,y) <t, x,y <= K i{e) }. 

The condition of the square summability of variation was introduced by A. 
Johansson and A. Oberg [7]. 

In this paper, we discuss contractive Markov systems which only have the Feller 
property, i.e. the Markov operator U maps the set of continuous functions into 
itself. For that to be satisfied, one needs only the continuity of the probability 
functions. 

Example 1 Consider two maps wo(x) := 9/10x and wi(x) := —x + 1/e for all 
x € [0, 1/e] with probability functions given as follows. Let a, S > such that 
a + 5 < 1. Set 

f -t^t + <$ if < £ < ± 
I o it x = 0. 

and pi(x) := 1 — po(x) for all a; € [0, 1/e]. Then a simple calculation shows that 
([0, 1/e], u>i,pi)i 6 {o,i} defines a CMS with an average contraction rate 1 — 9/105. 
Obviously, this CMS has the Feller property. Let (j> be the modulus of uniform 
continuity of po and < c < 1/e. Then 

<j>(c n ) = a for all n e N. 
'n log i 



Hence po does not have a square summable variation. Therefore, we do not 
know whether this CMS has a unique invariant Borel probability measure. It 
was shown by Berger, Hoffman and Sidoravicius [2] that the condition of the 
square summability of variation is tight, in the sense that for any e > there 
exists a (/-function with a summable variation to the power 2 + e such that 
the corresponding CMS on a one-sided full shift has several invariant Borel 
probability measures. 

In this paper, we intend to show that the coding map still can be defined if 
the probabilities are merely uniformly continuous (Proposition 2). This opens 



4 



a way of extending the thermodynamic formalism proposed in [17], and further 
developed and successfully used in [18], on the class of Feller CMSs. This leads 
to the generalization of Ledrappier's Theorem [10] (Theorem 2) and allows us to 
prove the existence of observable invariant measures for Feller CMSs (Corollary 

1)- 



2 Main part 

Let M. := (-Kj( e ), w e ,p e ) E be a contractive Markov system with an average 
contracting rate < a < 1. We assume that: (K, d) is a complete separable 
metric space; the family K\, ...,Kn partitions K into non-empty open subsets; 
each probability function p e \K i{e) is uniformly continuous and bounded away 
from zero by <5 > 0; the set of edges E is finite and the map i : E — ► V is 
surjective. 

Note that the assumptions imply that the CMS has the Feller property. 
Let P(A4) be the set of all invariant Borel probability measures of M. 

Proposition 1 (i) P{M) ^ 0. 
(ii) For every n € P{M), 

N 

^ / d(x, Xi) dfi(x) < oo for all Xi £ K i: i = 1, N. (2) 

Proof. See [4]. □ 

Note that if (2) holds for some Xj e Kj, j = 1, N, by the triangle inequality, 
it holds for all Xj € Kj, j = 1, N. 

Now, we are going to construct the coding map with respect to the generalized 
Markov measures associated with invariant measures of M. . 



2.1 Coding map 

Let S := {(..., <t_i, <7 , <7i, ...) : e, e E Vi G Z}. We shall denote by d! the 
metric on S defined by d'(a,a') := (l/2) fe where fc is the largest integer with 
<7j = cr^ for all |i| < k. Denote by S the left shift map on S. We call the set 
m [e m , e n ] :={tr£S: Gi = for all m < z < n}, for m < n € Z, a cylinder 
set. Let jU be an invariant Borel probability measure of Al. We call the shift 
invariant Borel probability measure M on S given by 

M( m [ei,...,efc]) := J p ei { x )Pe 2 { w e 1 x)...p ek {w ek _ 1 o ... o w ei x)d^(x) 7 

for every cylinder set m [ei, ...,efc], the generalized Markov measure (see [16]). 
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Proposition 2 Let /i € P{M). Let M be the generalized Markov measure 
associated with M. and /i. Let yi, Z{ <G Ki for all i = 1,...,N. Then the 
following hold. 



lim d(w ao o ... o w IJm (z t(<Jm) ),w IJ0 o ... o w (y i{ CTm) )) = M-a.e.. 

m^ — oo 

F Zl ... ZN := lim w CTo o ... o w ITm (z i ( (r )) exists M-a.e., 

m— >— oo 

and 6?/ (i) F Z1 ___ ZN = F yi _ VN M-a.e.. 

oo 

(raj There exists a sequence of closed subsets Qi C Q2 C ... C £ wii/i M(£\ 

fc=i 

Qfc) < 00 such that F Zl ... ZN \Q k is locally Holder- continuous with the same 
Holder-constants for all k e N, i.e. there exist a,C > swcft iftai /or every 
k there exists Sk > SMc/i iftai 

^a' e Q k with d'(a,a') < d k d(F Zl ... ZN (a),F Zl ... ZN (a')) < Cd'(a,a') a . 

Proof. Fix xj e Jfj for all j = 1, TV. 
(i) First observe that, for all to < 0, 

J d(w ao o ... o w^O;^)),-^ o ... o w CTm (2/i( CTm ))) dM 
= X! M (ni[e m ,---,e ])d(w eo o ...ow em (x l(em} ),w ea o ...ow em (y^ em} )) 

e m ,...,e a 

= Pe m {x)...p eo {w e _ 1 O...OW em (x)) 

J e m ,...,e 

Xd(w e0 O ... O We m {x i{em )),W eQ O ... O We m (yi(e m ))) dfj,(x) 
e m ,...,eo 

xrfK ••■ w e m (^(e m )), w eo o ... o w 6m (a;)) dn(x) 

+ / X! Pe m (a:)-Peo(^e_i ••• W 6m (x)) 
e m ,...,e 

xd(w ea o ...oa) £m (i),t» ej o ...ou; ero (y i(em) )) dfi(x) 
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N 

< X! / X! Pe m {x)...p eo {w e _ 1 o ... o W Cm (x)) 
3 = 1 K j e m ,...,eo 

x d(w eo o . . . o w em (xj ) , w eo o . . . o w Cm (x) ) d/x(x) 

+ / X] Pe m ( X )-"-Peo(We_ 1 O ••• O 

xrfK ••• ° «> ero (a;),lO eo ° •■• ° We m {Vj)) dfl(x) 
N . N . 

< a- m+1 Y^ / d( Xj ,x) dn(x)+a- m+1 Y^ / d(x,yj) dfi(x). 
Hence, there exists C > such that 

y d{w ao o...ow am (x i („ m) ),w ao o...ow am {y i ( am) )) dM < cr m+1 C for all m < 
Set 

An := |cr e S : d(w CTo o ... o uv m (ar i((Tm )), w CTo o ...oio^ft/j^))) > a^r^C 
for all m < 0. Then, by the Markov inequality, 

M(A m ) < for all m < 0. 

Now, let 

— CO — CO 

A:=f] \jA m . 

1=0 m =l 

Then 

M(A) < for a11 1 < °- 

7n<l 

Hence, M(A) = 0, but for all a e S \ A, 

lim d(«)„ G o ... oio % (x i( o ... o t« Jm (!( i(%) )) = 0. (; 



m— * — oo 



Analogously, holds 

lim d(w ao o ... o WlJm (x l{am) ),w aa o ... o w CTm (^( CTm ))) = M-a.e.. 

m^ — oo 

Hence, by the triangle inequality, 

lim d(w CTo o ... o w am {y i{am) ),w Uo o ... o w am (z l(am) )) = M-a.e.. 



Tfl — > — CO 



(ii) Let us abbreviate Y m (a) := w ao o ... o w am (xi(a m )) for a € X and m < 0. 
Then similarly as in the proof of (i), for all m < 0, 



d(y m ,y m _!) dM 

e m _i,...,e 

° - O »e m (l,(e m )),'«eo ° - ° ^e m _! (^(e m -i))) ^(^) 

- j Y Pe m - 1 (x)...p eo (w e _ 1 O...OW em _ 1 (x)) 

e m -i,...,eo 

xd(w eo o ... o ii)e m (a; i (e m )), w eo o ... o e^(x) 

+ y Y Pe m -i( x )--Peo( w e-i ° ••• ° ™e m _i(x)) 
e m -i,...,eo 

xd(w e „ o ... o w 6m _ 1 (x), w eo o ... o w em _ 1 (x 4(em _ l) )) d/x(x) 

AT 

- Y Y Pe m - 1 {x)...p ea {w e _ 1 ...OW^^ix)) 
i=l (e m _i,...,e ), t(e m -i)=j=i(e m ) 

xd(w eo o ... o W em (Xj),W eo o ... o We^^x)) d[l(x) 
N 

+ YJ Y Pem-i( x )~Pe {We- 1 O...OW em _ 1 {x)) 
j =1 K. e m -i,...,e 

xd(w eo o ... o w em _ 1 (x),w eo o ... o w em _i(xj)) d^t(x) 

N 

< a- m+1 ^2J Pe m - 1 (x)d(x j ,w em _ 1 (x)) dv(x) 

j=l e m _i,t(e„,_i)=j 

+a-" l+2 ^] / d(x,Xj) d//(ar) 
= a- m+1 ( U (j2l Kj d( Xj ,.)\ (x) dLi(x)+a- m+2 J2 I d(x, Xj ) dn{x) 
= a- m+1 / Y, 1 K j d(x j ,x) dn(x)+a- ,n+2 Y^ / d(x, Xj ) dfi(x) 

Hence, there exists C > such that, 

J d(Y m , F TO _i) dM < a- rn+1 C for all m < 0. 

Let 

B m -i := jo- e S : rf(y m ,F m _i) > a^^cj for all m < 1. 



Then, by the Markov inequality, 

M(B m _i) < a^r 1 for all to - 1 < 0. 

Let 

— CO — GO 

b : = n u S - 

i=0 m=l 

Then 

M(B) < ^ for all Z < 0. (4) 

Hence, M(B) = 0, and for all a £ S \ S, the sequence (i / m (cr)) m <o is Cauchy. 
Thus 

F X1 ... XN := lim w CT0 o ... o w CTm (a; i((7m) ) exists M-a.e., 

m—* — oo 

and by (3) F yi ._. yN also exists M-a.e.. 
(iii) Let 

— oo 

Qi := S \ |J B m for all i € Z \ N, 

m— / 

where B m as in proof of part (ii). Then Qi C Qi-i for all / G Z\ N. Since every 
Y m is continuous, B m is open for all to £ Z\N, and so, every Q; is closed. Since 
M(B m ) < for all to < 0, 



-CO —CO 



^M(S\0 ; ) = EE fl ^ 

(=0 l=Q m=l 

Now, let (J, a' € Qi for some I. Then 

rf(F m (cr),y m _i(cr)) < a^^C for all to - 1 < I. 
Therefore, by the triangle inequality, 

d{Y m {a),Y m Ja)) < V 0^(7 = C- = for all to - 1 < I, k > 1. 

^ 1 - va 



Hence 



d(y m (CT), J F Xl ... XN (o-)) < C 1 a' m 2 11 for all to - 1 < I. 

1 — y a 



Analogously, 



d(Y m (a'),F Xl ... XN (a')) < C— !-= for all to - 1 < I. 

1 — \J a 
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Now, let Si = (1/2)!'- 1 !, a := log y/a/ log(l/2) and d'{a,a') = (l/2)l m - 1 l for 
some m — 1 < I. Then Y m (a') = Y m (a). Therefore, 

d{F Xl ... XN {a),F Xl ... XN {a')) < -™-= = -^-= d'(a,*T- 



Remark 2 Note that the Feller property of M was noi used in the proof of 
Proposition 2. It only insures that P{M.) is not empty. 

Definition 5 We call the map 



which is well defined by Proposition 2, the coding map of the CMS. 
Remark 3 Proposition 2 generalizes Corollary 1 from [16]. 

2.2 Thermodynamic formalism 

In this subsection, we improve some results from [17] and [18]. In [17], we initi- 
ated the development of the thermodynamic formalism for contractive Markov 
systems. It was shown that it goes beyond the scope of the existing theory of 
equilibrium states. Namely, in case of contractive Markov systems we have to 
consider local energy functions which are not upper semicontinuous. In [18], 
we successfully used the developed thermodynamic formalism for the proof of 
the uniqueness of the invariant probability measure for CMSs satisfying a 'reg- 
ularity condition' which holds if the probability functions p e \K i(e) have square 
summable variation. 

Definition 6 Let X be a metric space and T a continuous transformation on 
it. Denote by P{X) the set of all Borel probability measures on X and by 
Pt(X) the set of all T-invariant Borel probability measures on X. We call a 
Borel measurable function / : X — ► [— oo, 0] an energy function. Suppose that 
T has a finite topological entropy, i.e. sup egPT ( X ) h@(T) < oo, where h@(T) is 
the Kolmogorov-Sinai entropy of T with respect to measure 0. We call 



□ 




K. 



P(f) 



sup (h e (T) + 6(/)) 



eeP T (x) 



the pressure of /. We call A S Pt(X) an equilibrium state for / iff 



h A (T) + A(f) = P(f). 



Let's denote the set of all equilibrium states for / by ES(f). 



Now, we define the energy function for the CMS M. 
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Definition 7 Fix Xi G Ki for each i = 1, N. In what follows, let's denote 
F Xl ... XN simply by F. Let 

£ G := {a e E : tfo) - ifa+i) Vj G Z}, 

D := {it £ Sg : lim tu CTo o w cr _ 1 o ... o w (7m Xi( cr ) exists} 

m— >— oo 

and 

oo 
i= — oo 

Set 

«(*) = { oF W . f if *!T ( 5 ) 

v ' [_ -oo if a G S \ r. w 

Lemma 1 (%) -F(ct) is defined for all a G y and F is a s/ii/f invariant subset 

(m,) For every /i G P(A4), M(Y) = I, where M is the generalized Markov 

measure associated with the CMS and [i. 

(Hi) Suppose Ai is irreducible. Then Y is dense in Eg- 

Proof, (i) is clear, by the definitions of F and Y. Since each map w e \K i{e) is 
continuous, S(D) C D. By Proposition 2, M{D) = 1. This implies (ii). If M 
is irreducible, then fi(Ki) > for all i = l, ...,N (e.g. Lemma 1 in [15]). Hence 
M(0) > for every open O G Eg- This implies {Hi). □ 

Remark 4 (i) Note that Y and F depend on the choice of Xi's. By Proposition 
2 (i), y changes only modulo M-zero set by a different choice of x^s. 
(ii) If all maps w e \K i{e) are contractive, then Y — Eg and F\^ G is Holder- 
continuous (easy to check). 

Remark 5 As far as the author is aware, the rigorous mathematical theory of 
equilibrium states is developed only for upper semicontinuous energy functions / 
(see e.g. [9]). This condition insures that the convex space ES(f) is non-empty 
and compact in the weak* topology. However, as the next example shows, u is 
not upper semicontinuous in general. Therefore, even the existence of an equi- 
librium state for u is not guaranteed by the existing theory of thermodynamic 
formalism. 

Example 2 Let (K,d) = (R, |.|). Consider two maps 

w (x) := ^x, Wi(x) := 2x for all x G R 
with probability functions 

Po{x) := -j sin 2 x + i^, pi(x) := i cos 2 x + ^ for all x G R. 
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Then a simple calculation shows that (R, w e ,Pe)ee{o,i} defines a CMS with an 
average contracting rate 45/48. In this case, Eg = {0, 1} Z . If we take x = for 
the definition of Y, then, obviously, Y = Eg- Now, let x ^ 0. Let No n (a) and 
Ni n (a) be the numbers of zeros and ones in (ct_„, (To) respectively for every 
ct e S G . Then, obviously, a <£ Y if (A?i„(ct) - N 0n (o-)) — > oo. Hence, 7^E G 
and, by Lemma 1 (iii), Y is a dense shift invariant subset of Eg- Since Y is not 
closed, u is not upper semicontinuous. 

Also, it is not difficult to see that in a general case there is no hope to find X{ 
such that u becomes upper semicontinuous, e.g. change w\ to w\{x) = 2x + 1, 
then, for any choice of x for the definition of Y, Y ^ Eg- 

Before we move to the results on thermodynamic formalism for general CMSs, 
let us consider an important example, the thermodynamic formalism for which 
was elaborated by Ledrappier [10]. 

Example 3 Let G := (V,E,i,t) be a finite irreducible directed (multi)graph. 
Let E G := {(..., C-i, cto) : ct to <G E and t{a m ) = i(a m -i) Vm € Z \ N} (be 
one-sided subshift of finite type associated with G) endowed with the metric 
d(a, ct') := 2 k where k is the smallest integer with Oi = ct- for all k < i < 0. Let 
g be a positive, continuous function on Eg such that 

X! 9(y) = 1 for all x e E G 

2/GT-i(M) 

where T is the right shift map on E G . Set Ki := {ct e E G : t(ao) = *} for every 
i e V and, for every eeE, 

w e {a) := (...,CT_i,CT ,e), p e {a) := g{..., ct_i, ct , e) for all ct e if i(e) . 

Obviously, maps (w e )ee-E are contractions. Therefore, := (-fQ( e ), w e ,Pej e&E 
defines a CMS. An invariant probability measure of such a CMS is called a g- 
measure. This notion was introduced by M. Keane [8]. Let U g be the Markov 
operator associated with CMS M g . The following theorem characterizes the 
g-measures as equilibrium states for log g. 

Theorem 1 (Ledrappier, 1974) Let m € P(E G ). Then the following are 
equivalent: 

(i) U g *m = m, 

(ii) m £ Pt(E g ) and £ l m (l r e i \T~ l B) = p e °T m-a.e. for all e e E where T~ X B 
is the a-algebra generated by cylinder sets of the form _fe[e_fe, e_i] C E G , 

(iii) m € fV(E G ) andm is an equilibrium state forlogg with h m (T)+m (log g) = 
0. 

Proof. See [10] or [13]. There, the g-measures are called the invariant measures 
of the Ruelle operator C g , given on the space of all Borel measurable functions 
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4> on £ G by 

£g<p{x) := ^2 9{y)4>{y) for all x £ £ G . 

However, L g is nothing else but the Markov operator associated with CMS M. g . 
In deed, for every function (j> and a £ £ G , 

£g<t>(<r) = ^2 5(---, cr -i,c r o,e)(/)(...,cr_i,cro,e) 

eeE: i(e)=t((7o) 
= ^PeW^O We(<7) 

= 



□ 



Let 7r : £ G — > £ G be the natural projection. We call n(A) the natural 
restriction of A S P(E(j) on £ G , and we call A S P(£gO ifte natural extension 
of A € P(£ G ) if and only if 7r(A) = A. Obviously, for every A £ Pt(2 g ) the 
natural extension is unique. Observe that, in this example, the coding map 
F = 7r. The following proposition explains the relation between (/-measures and 
the generalized Markov measures. 



Proposition 3 The generalized Markov measure associated with CMS M. g and 
a g-measure is the natural extension of the g-measure, or in other words, every 
g-measure is the image of the corresponding generalized Markov measure under 
the coding map. 



Proof. Let m g £ P(£ G ) be a (/-measure. Let M g £ P(S) be the generalized 
Markov measure associated with CMS M g and m g . Then, for every cylinder 
set _ fc [e , ...,e k ] C £ G , 

mg(-k[eo,...,e k ]) = U g * k+1 m g (- k [e Q , e fe ]) 



■/ 
- /« 



Pel_ fe [e ,...,e fe ] ° W e dU g * k m g 

e£E 



e fc l_ fc [e ,...,e fc ] ° * efc dU m g 



J2p e Pe k «eL 1 [e,,... A ] ° W Cfe O W e dU g * k Vg 
Pe k -iPe k OWe,.,!.,^ ej ° *e fc ° dU g * ^ m g 
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= J Pe Pe 1 OW eo ...p ek O W ek _ t O ...OW eo 

X L t k.,ed°< ° o ... o w eo rfm g 

= j Pe a Pe 1 O W eo ...p ek O W £k _ 1 O ... O W ea dm g 

= ™( M g) (-fe[eo, -,efe]). 
Hence, m g = n (M g ). □. 

Now, we are going to prove a generalization of Theorem 1 which will relate 
invariant measures of CMS with equilibrium states of u via the coding map. 

Let A® be the finite tr-algebra on S generated by the zero-time partition {o[e] : 
ee^}. Set jr : = V~ 5M . 

Theorem 2 Let jj, € P{K). Then between the statements 

(i) U*n = n, 

(ii) £ , M(l 1 [ e ] l-^ 7 ) = Pe ° F M-a.e. for all e £ E, where M is the generalized 
Markov measure associated with M. and jj,, 

(Hi) M is an equilibrium state for u with P(u) = 0. 
(iv) U*F(M) = F(M) 

hold the implications (i) (ii) => (Hi) (iv). 
Proof, (i) => (ii) By Proposition 1 (ii), 

N 

^ / d(x, Xi) d[i(x) < oo for all x t <G Ki, i = 1, ...,N, 

and by Lemma 1 (ii), M(Y) — 1. Therefore, (ii) follows by Lemma 6 from [17] 
(in [17], we considered if to be a locally compact space, but this was not used 
in the proof of Lemma 6) . 

(ii) =4> (Hi) holds by Lemma 5 from [17] (the same argument as in the proof of 
Proposition 1 in [17]). 

(Hi) (iv) holds by Proposition 2 from [17] (the local compactness was not 
used in the proof of Proposition 2 from [17]). □ 

Remark 6 Observe that, by Proposition 3, Theorem 2 is a natural generaliza- 
tion of Theorem 1. 

Theorem 3 Suppose CMS M. has a unique invariant Borel probability measure 
[i. Then the following hold. 

(i) M is a unique equilibrium state for the energy function u, 

(ii) F(M) =fi, 

(Hi) h M (S) = - J^eeE I Kiie) P e lo g^ e 
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Proof. By Lemma 1 (ii), M(Y) = 1. Therefore, the claim follows by Theorem 
2 form [17] (the local compactness was not used for that). □ 

Remark 7 The author would like to point out that a similar entropy formula 
as that proved in Theorem 3 (iii) plays a central role in the recent book of 
Wojciech Slomczynski [12]. 

Now, we intend to show that the images under the coding map of ergodic equi- 
librium states for u which are absolutely continuous with respect to generalized 
Markov measures are not only invariant, but also observable. 

Definition 8 We call ji € P{K) observable with M. from i e if if and only if 

1 ™ 

- 8 W e i o...ow ei (x) ^ M f° r Px-a-e. o e S + . 
Note that, by Lebesgues Dominated Convergence Theorem, 

n 

- £ Wf(x) - n(f) 

2 — 1 

for all bounded continuous functions / if \i is observable from x. 

First, we need to show that there exist ergodic equilibrium states for u which 
are absolutely continuous with respect to generalized Markov measures. 

In [18], we have proved the following lemma. 

Lemma 2 Let A <E ES(u) and A € Ps{^) such that A is absolutely continuous 
with respect to A. Then A g ES(u). 

Proof. See [18]. □ 

Proposition 4 Let /i € P(A4). Then there exists an ergodic equilibrium state 
A for u such that A is absolutely continuous with respect to M , where M is a 
generalized Markov measure associated with M. and \x. 

Proof. By Theorem 2, M is an equilibrium state for u. Since S is a compact 
metric space, it is well known that Ps(^) is a compact (in the weak* topology) 
convex space. By the Krein-Milman Theorem, Ps(S) is a closed convex hull of 
its extreme points, which are exactly the ergodic measures (see e.g. Theorem 
6.10 in [14]). Furthermore, the ergodic measures can be characterized as the 
minimal elements of the set with respect to the partial order given by the 

absolute continuity relation (see e.g. [9], Lemma 2.2.2) (to be precise, the ab- 
solute continuity relation is a partial order on the equivalence classes consisting 
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of equivalent measures, but every equivalence class containing an ergodic mea- 
sure consists of a single element). Therefore, there exists an ergodic A G Ps(^) 
such that A is absolutely continuous with respect to M. Thus, by Lemma 2, 
A G ES(u). □ 

Before we move to the theorem, we need to prove a lemma. 

Let S + := E K endowed with the product topology of the discreet topologies. 
Let v G P(K). Since x i — > P X (Q) is Borel measurable for all Q G #(E + ) (see 
e.g. Lemma 1 in [16]), we can define 



4>(v)(AxQ) := J P x {Q)dv(x) 



for all A G B{K) and Q G 2?(£ + ). Then 4>{v) extends uniquely to a Borel 
probability measure on K x S + with 



0(i/)(fi) 



/ P x ({a G S+ : (x,cr) 



for all Q G B(K x £+). Note that the set of all fl C K x £+ for which the 
integrand in the above is measurable forms a Dynkin system which contains all 
rectangles. Therefore, it is measurable for all G B (K x £ + ). 

Now, consider the following map 

£ : S — > if x £+ 

(T I ► (F(a), (<7i,CT 2 , ...)). 

Lemma 3 Le£ A G -Ps(S) foe an equilibrium state for u such that A is a&so- 
toeZy continuous with respect to M where M is a generalized Markov measure 
associated with M. and ji G P{M). Then 

£(A) = #F(A)). 

Proof. We only need to check that 

£(A) (4 x x [ei, e„]+) = 4>(F(Aj) (A x 1 [e 1; e„]+) 
for all cylinder sets i[ei, e„] + G S + and A G B{K). For such sets 
P(4xi[e 1 ,..,e„]+) = A^-^AJfli [e u ...,e n ]) 



I 



li[ei,...,e„]^A 



where i[e l7 ...,e„] G £ is the pre-image of i[ei, ...,e„] + under the natural pro- 
jection. Recall that F^ 1 (A) G T . Therefore, by Theorem 2, 

E M (l^e] l^ 7 ) =Pe°F M-a.e. for all ee£. 
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Since A is absolutely continuous with respect to M, 

E A (l l[e] \f) = p e o F A-a.e, (6) 

analogously as in the proof of Lemma 7 in [18]. This implies, by the shift 
invariance of A and the pull-out property of the conditional expectation, that 

EA(l l[e ^...,e n ]\^) = P F (a) (i[ei,...,e„]+) A-a.e.. 

Therefore, 

J l 1 [ ei ,..., e „]dA = J P f{<t) (i[ei,...,e„] + ) dA(a) 

F-i-(A) F'i-(A) 



J P x ( 1 [e 1 ,...,e n }+)dF(A)(x), 



as desired. □ 

The following theorem is a little bit more then just the usual strong low of large 
numbers. 

Theorem 4 Let A be an ergodic equilibrium state for u such that A is abso- 
lutely continuous with respect to M where M is a generalized Markov measure 
associated with M. and jj, € P(A4). Let f e : K — ► [— oo,+oo] be Borel mea- 
surable such that f e \K i{c) is bounded and continuous for all e £ E. Then, for 
F(A)-a.e. x e K, 

1 ™ _1 f 
lim - V f a o w ak o ... o w Gl (x) = V / p e /e d/i 

-K»(e) 

for P x -a.e. a € E + . 

Proof. Since A is an equilibrium state for u, A(Y) = 1 (otherwise }ia(S)+A(u) = 
-oo < P(u)). Set 

v{<7) \ -oo ifaes\y. [i) 

Then, by Birkhoff's Ergodic Theorem, 

1 ™ _1 f 
-^uoS'^ v dA A-a.e.. 

n k=o 

Since F o S k (<r) = w ak o ... o w (Jl (F(a)) for all a e Y, we can assume, without 
loss of generality, that 

- fa k+1 ° Wcr fc ° ••• ° w<7i (F{&)) v dA for all <r E F. 

n fe=o 7 
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By (6), 

v dA = lim / l.fein A / e o F dA = lim p e o Fn A f e o F dA 

J e£E J eeE J 

= lim Y, f PenAf e dF(A) = Y f Pefe dF(A). 
Now, applying the map £, we get 



1 ™ _1 /" 

(x, cr) e 

71 fc=0 eeE ifi, 



fc=0 e£E t 

»(e) 



By Lemma 3, 4>(F (A)) (£(¥)) = £(A)(£(F)) = A^" 1 ^))) > A(F) = 1. Since 
^(i^A)) is a probability measure, 

1 = 4>(F(A))(£(Y)) = J P x ({a€X+ :(x,a)€£(Y)})dF(A)(x) 

Since < P x ({cr G S + : (x, cr) G < 1 5 it is a simple consequence of 

Lusin's Theorem, that P x \{a G £+ : (x,a) G = 1 for F(A)-a.e. x G K. 

If we set for such x, 

Q x := {a &Y+ :{x,cr) 

Then P^Q*) = 1 and 



1 n_1 /" 

— y ' /(Tfc+l ° W Ofc ° ••• ° W CTl 

(x) -» ^ / Pe/e df(A) for all aeQ,. 



This completes the proof. □ 

Corollary 1 There exists [i G P(K) which is observable with M. from /i-a.e. 
x G if. Moreover, for [i-a.e. x G if, 

lim -logP x (i[<7i,...,<7„]) = V / p e log p e dfi 



for P x -a.e. a G E + . 



Proof. Let / be a bounded continuous function on K. Set f e :— f for all e G P. 
Then, by Proposition 4 and Theorem 4 and Theorem 2, there exists G P{M) 
which is observable from ^-a.e. x G K. Now, set f e := logp e for all e G P. 
Then, by Theorem 4, for /z-a.e. a: G if, 

lim - log[p CTl (a;)p CT2 o (x)...p CTn o u; CTn _! ° ••• ° w ai (x)] = V" / p e logp e d/x 

n^oo n * — ' / 



(e) 



for P^-a.e. cr g £+. □ 
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Remark 8 Note that Corollary 1 also might have some practical value in case 
of CMSs on R™, e.g. which are used for image compression, if [i is also non- 
singular with respect to the Lebesques measure. The latter happens some times 
if the images u> e (-fQ( e )) do overlap. 
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